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MEMORANDUM FOR: Director of National Estimates 

Deputy Director for Intelligence 

Deputy Director for Science and Technology 

SUBJECT: Involvement of the NSCIC and its Working Group 

in the NIE/SNIE Program 


1 . Attached is a draft proposal from | | shop by which 

the NSCIC would become involved in commenting on proposed NIE 
quarterly schedules, and the NSCIC Working Group would become respon- 
sible for preparation of an evaluation form on each NIE and SNIE following 
publication. The proposal also provides for inviting representatives of 
non-USIB agencies to comment on draft terms of reference for NIEs and 
SNIEs. 


2. As you know, we are trying very hard to find ways and means of 
responding to the President's charge that the intelligence product be 
improved, and the attached proposal, or some modification of it, seems 
an essential part of such a program since the NIEs and SNIEs are such key 
elements in the intelligence community's coordinated production effort. 

I am aware of a tendency to take a jaundiced view of surveys and devices 
of this kind, but it is nonetheless true that the NIE and SNIE process has 
been subjected to these before (a summary of them is attached), not without 
some thoroughly useful results. These suggestions are intended to try to 
carry the process a couple of steps further. 

3. In his memorandum of 16 February to the other NSCIC members, 
"NSCIC Working Group Proposed Studies," Dr. Kissinger recommended 
approval of the proposal to initiate the NSSM-69 and India -Pakistan crisis 
studies, but his final comments were as follows: 

"Some lessons regarding the formulation and expression 
of needs may result. But these studies may not help us 
very much in better expressing our needs. Therefore, 

I urge the Working Group to continue its efforts to design 
a work program that will assist us in all our tasks. " 
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? ® P ro P osa ^ s * n the attached papers are an attempt to respond directly 
to this request insofar as NIEs and SNIEs are concerned. 

t' am n0t ’ of coure «> going to make any attempt to raise this 

diocun! R ° U n meCting ° n 6 JuJ y* but l land I would like to 

discuss it with you as soon as possible and would thus appreciate your 

comments as soon as you can provide them. Y 
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Attachment; as stated 


(SJgzfiisJ Bfo'mrr, 

Bronson Tweedy 
D/DCI/1C 
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MEMORANDUM FOR: Mr. Tweedy, D/DCI/IC 

SUBJECT: Consumer Participation in the NIE/SNIE Program 


1. Attached are copies of the draft project proposal, with 
which you already have agreed in principle, which I recommend 

you send to John Hui2enga, Ed Proctor and Carl Duckett for comment. 

2. The package has been drafted in the format in which I 
suggest it be on completion of NSCIC Working Group action. 

This Includes (in addition to your memo to John, Ed and Carl): 

a. A draft memorandum from you to the Chairman, NSCIC, 
as Chairman of his NSCIC Working Group. 

b. As Tab A to this basic memorandum, a copy of the 
draft Working Group study, "Consumer Participation In the 
NIE/SNIE Program." This study has two annexes: Annex A, 
"Surveys of User Reactions to National Intelligence Estimates," 
and Annex B, "Consumer Evaluation of National Intelligence 
Estimates (NIE) and Special National Intelligence Estimates 
(SNIE)," which is a three-page evaluation form to be filled 
out on each estimate. 

c. As Tab B to the basic memorandum, a draft Implementing 
memorandum for Mr. Kissinger to send to the NSCIC principals 
Implementing the proposals submitted by the Working Group. 

3. The memorandum I have drafted for you to send to 
John, Ed and Carl requests their comments "within the next few 
days if possible," but I doubt that we will have answers in 
time for you to discuss this project at the Working Group meeting 
on 6 July. 


Chief, PRG/IC 

Attachments 
as stated 
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MEMORANDUM FOR: Chairman, National Security Council Intel! i 

Commi ttee 


gence 


SUBJECT: 


Consumer Participation in the National Intel! i 
Estimate Process 


gence 


1. At Tab A is a study, approved by the NSCIC Working Group, 
which proposes greater consumer involvement in'the National 
Intelligence Estimate (NIE) and Special National Intelligence 
Estimate (SNIE) process by three steps: 

a. Submission of proposed NIE quarterly schedules to 
NSCIC members for approval and/or comment. 

b. Participation by representatives of appropriate 
consumer organizations in the review of NIE and SNIE terms 

of reference, on invitation of the Director of National 
Estimates. 

C. Provision by NSCIC Working Group members who 
represent NSCIC principals of comments on each published 
NIE and SNIE by completion of evaluation forms. (Sample 
form is at Annex 8 of the study at Tab A.) i 

2. At Tab B is a memorandum which the NSCIC Working Group , 

recommends be approved by the NSCIC and issued as guidance to the 
NSCIC member organizations. 


Bronson Tweedy 

Chairman, NSCIC Working Group 
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DRAFT 


SUBJECT: Consumer Participation in the NIE/SNIE Program 
PROBLEM 

1. To respond to the Presidential directive that the national 
intelligence product be improved by providing for increased 
involvement of high level consumers in the formulation of the 
National Intelligence Estimate (NIE) and Special National Intelligence 

Estimate (SNIE) programs and in the evaluation of the NIE and SNIE 
output. 

INTRODUCTION 

2. The President's memorandum of 5 November 1971, "Organization 
and Management of the U.S. Foreign Intelligence Community," and 
NSCID No. 1, "Basic Duties and Responsibilities," 17 February 1972, 
which called upon the Director of Central Intelligence to improve 
the "quality, scope and timeliness of the community's product", 
represent explicit criticism of the national intelligence product, 
although the finger is not pointed specifically at any particular 
type of intelligence publication. 

3. Since the NIE and SNIE documents represent the primary 
community-coordinated output of U.S. intelligence, and since these 
estimates are intended for the use of high-level consumers, it appears 
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appropriate that attention be directed to exploration of means by 
which the NIE/SNIE program could be made more responsive to the 
needs of the policy making levels of the federal government. 

The proposals considered relate to three aspects of the N I E 
program and two aspects of the SNIE program: 

a. The input of NSC, State Department and Defense 

V 

Department recommendations during development of the 
quarterly NIE production schedules. (There is no 
comparable scheduling program for the SNIEs.) 

b. The participation of offices not a part of the 
intelligence community in review of terms of reference for 
NIEs and SNIEs prior to start of the drafting process. 

c. The preparation of specific evaluations on 
individual NIEs and SNIEs by senior level customers. 

4. Since the National Security Council Intelligence Committee 
(NSCIC) was established to "give direction and guidance on national 
substantive intelligence needs and provide for a continuing evaluation 
of intelligence products from the viewpoint of the intelligence 
consumer," the following discussion of the NIE and SNIE programs 
focuses on the manner in which the NSCIC and its subordinate body, 
the NSCIC Working Group, could be utilized. 
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DISCUSSION 

Developing the MIE Program 

5. The NIE program is promulgated each quarter. The schedule 
is initiated by the Director of National Estimates and is concurred 
in by the Board of National Estimates (BNE). after conferences with 
representatives of production offices for agreement on subjects and 
the allocation of production resources. The proposed schedule is 
disseminated to USIB representatives to give them an opportunity 
for review and conferences with their policy counterparts, if 
they choose to do so. The final program is submitted to the USIB 

and recommended by the Board to the Director of Central Intelligence 
for approval. 

6. Considerable variation occurs from quarter to quarter, but 
about half of the schedule entries are estimates which are reissued 
on a periodic basis (such as the NIEs on Soviet military capabilities); 
approximately one-fourth are estimates which are scheduled on the 
basis of a specific request via policy channels and about one-fourth 
are entered into the schedule on the initiative of the BNE in the 
expectation that the estimates will address problems to be faced by 
policy makers within the time frame of the document. 

7. Direct contact between intelligence and policy making levels 
takes place on occasion during development of the NIE schedule, but 
it is not regular or formalized. The Director of National Estimates 
has informally asked the Chief of the Net Assessment Group, NSC Staff, 
to serve as a funnel for input of NSC proposals concerning estimates. 
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Some intelligence production personnel with geographic specialties 
maintain liaison with policy and operational offices involved with 
that same geographic area. The present system, however, does not 
provide for inputs from outside the intelligence community which 
explicitly indicate that top level officials personally have concurred in 
the proposed NIE schedule or have suggested deletions or additions of 
specific subjects relating to their responsibilities. 

8. In order to provide a formal mechanism for regular inputs from 
the policy making levels and to provide the intelligence community 
with more direct indication as to the needs of top level consumers, it 
is proposed that the draft NIE schedule, as approved by the Director 
of National Estimates, be distributed to members of the NSCIC Working 
Group at the same time it goes to USIB representatives. Those Working 
Group representatives who represent NSCIC principals would be 
requested to arrange for provision of the comments and/or concurrence 
of their principals on each quarterly schedule to the Chairman, NSCIC 
Working Group, and to the Director of National Estimates. This would 
increase assurance that the BNE is working on NIEs which deal with 
problem areas identified as being of significance to the planning and 
decision making requirements of top level consumers. These responses 
also would provide a channel for requests from the NSCIC principals 
for both NIEs and SNIEs. 
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Participation by Non-USIB Agencies 
in Review of NIE/SNIE Terms of Reference 

9. At the present time, representatives of non-USIB organ- 
izations do not participate in the drafting of terms of reference 
for NIEs and SNIEs, or in the actual consideration of draft 
estimates during the process which leads to USIB consideration. 

10. There is growing recognition, however, that in some 
areas the interests of non-USIB organizations are such that the 
intelligence product will be improved by the inclusion of 
representatives of non-USIB organizations. The expansion of 
participation by non-USIB agencies involved in international 
economic, financial and trade problems in activities of the 
USIB Economic Intelligence Committee is an illustration of this. 

11. It could well be that participation by personnel representing 
policy and operational levels of the NSC Staff, the Departments 

of State and Defense, or other federal agencies as appropriate, 
in the drafting and/or review of terms of reference for NIEs and 
SNIEs would improve the likelihood that the final estimate will 
be of optimum value to its principal users. 

12. Participation of representatives from policy levels of the 
government in the evolution of a National . Intelligence Estimate might 
be considered to represent a distinct departure from the concept that 
there should be a complete separation of intelligence activities from 
policy considerations. On the other hand, such participation offers at 
least the possibility of enhancing the likelihood that the estimate . 
will include consideration of the questions on which intelligence 
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judgments will have a distinct bearing when the subject to which the 
estimate applies is being handled at the policy levels. The 
probability!, or even the chance, that such participation could result 
in improving the responsiveness of NIEs and SNIEs to the needs 
of top level consumers suggests that the effort should be made, at 
least on an experimental basis. 

V 

13. It is proposed, therefore, that the NSCIC 

suggest j to the Director of Central Intelligence that the Director 
of National Estimates be requested to invite the participation of 
representatives from the NSC Staff, the Department of State, and the 
Department of Defense (or of other government agencies as 
appropriate) when he considers that the subject of the NIE or SNIE 
is one in which inputs to the terms of reference by personnel from 
outside the intelligence community would be useful. 

14. It is further proposed that the Director of National 
Estimates prepare an appraisal of the usefulness- of this procedure 
after a period of test and that he submit his comments and 

recommendations to the Director of Central. Intelligence as basis for 
a DCI report to the NSCIC. 

Systematic Evaluation of NIEs and SNIEs 


15. A number of attempts have been made in the past two decades 
to elicit consumer evaluations of intelligence products. Most of 
such projects have involved the use of questionnaires sent to 
recipients of the various documents. In no cases have the results 
of general surveys been deemed adequate to provide direct basis for 
revision of a major production program. 
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16. At Annex A is a description of surveys which have been 
made of user reactions to National Intelligence Estimates. In 
quite marked contrast to the general surveys was the success 
achieved when the DCI in 1969 asked the Secretary of State, the 
Secretary of Defense and the Assistant to the President for 
National Security Affairs for their views or suggestions as to how 
NIEs on Soviet military subjects might be made "most useful" to them. 
(Pages A-5 - A-7 of Annex A describe this exchange.) This 
correspondence resulted in a major revision of the format of 

these NIEs and a marked expansion of the material included in the 
annexes. 

17. The success of this effort suggests that involvement of 
these same top level officials, or their representatives, in the 
evaluation of NIEs and SNIEs on a continuing basis would provide 

valuable inputs for the improvement of the national intelligence 
estimates process. 

18. Inasmuch as the NSCIC Working Group has been created to 

support the NSCIC in execution of its responsibility to provide 
substantive intelligence guidance to the intelligence community, it 
appears appropriate that the Working Group members be tasked with a 
responsibility for providing feedback to the Working Group Chairman 
and to the Director of National Estimates on each NIE and SNIE which 
is published. It would be the responsibility of each Working Group 
member to arrange for obtaining comments on - 

each NIE and SNIE from the consumers of primary interest within 
his organization. 
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19. Attached at Annex B is a copy of the questionnaire which 
would be used. It is proposed that the Chairman of the NSCIC 
Working Group forward a copy of each NIE and SNIE as it is 
published, along with the questionnaire, to those members of the 
Working Group who represent NSCIC principals. Those Working 
Group members would be charged with furnishing the Chairman of 
the Working Group and the Director of National Estimates with 
evaluations of each NIE and SNIE. 

20. Over a period of time these assembled comments should 
provide guidance to the Director of National Estimates as to how 
the various high level users of the NIEs and SNIEs, as represented 
on the NSCIC, consider the estimates could be improved in content, 
style, format and overall responsiveness to policy needs. These 
comments would provide' a vehicle by which consumers who may be 
critical of the depth of analysis or of the approach used in a 
particular estimate can make these reactions known to those who 
are responsible for preparing estimates in that subject matter area. 

RECOMMENDATION 

21. It is recommended that the NSCIC Working Group approve 
the proposals contained in this study and' that an appropriate action 
memorandum be submitted to the NSCIC. for approval and issuance as 

guidance to the Director of Central Intelligence and the NSCIC 
Working Group. 


Approved 
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SURVEYS OF USER REACTIONS 
TO NATIONAL intelligence estimates 


1- The expansion of the U. S. intelligence community since World 
War II has resulted, among other things, in a marked increase in the 
output of intelligence products--estimates, serial publications, reports, 
ulletins, memoranda, etc. Wide variation exists in the audiences to 
which individual products are addressed and in the number of copies 
which are disseminated. Because of concern as to whether the right 
audience was being reached or whether the products themselves were 
responsive to the needs of consumers, various intelligence organizations 
have conducted surveys of one type or another to measure consumer 
reactions, usually in the interest of obtaining comments which would 
provide basis for improvement of the product. The following paragraphs 
describe the more important of such efforts relating to National Intelli- 
gence Estimates, and an assessment of the results achieved. 


2. Survey of 1955 

.. Februar y 1955 the Director of Central Intelligence asked 

the Board of National Estimates to conduct an informal survey of 

whlch consumers made of National Intelligence Estimates 
(NIE s). The survey, which was undertaken after four years 
experience with the national estimate system, was intended to shed 
light on (1) whether NIE's were circulated appropriately; (2) who, 
eside s the National Security Council, werd the ultimate consumers- 
' jh°w extensively NIE's were actually used by these consumers; 
an (4) the extent to which, as then written, the NIE's met such needs. 

b. The survey was conducted in two stages. The first was a 
written questionnaire addressed to all offices and agencies receiving 
NIE s and intended to indicate NIE dissemination within each agency. 
The second stage was a series of interviews with a sample of policy- 
ma -er consumers to ascertain what use they actually made of NIE's. 

e survey was not intended to obtain opinions regarding the 
adequacy of NIE content or judgments on changes to make them 

- ’EXEMPT FROM GEHERAl DECLASSIFICATION SCHEDULE 
OF E. 0 . JIG?, EXESriO.I C.ME39ST: 
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more useful. The primary goal was to establish the distribution 
pattern of NIE' s and to indicate the kinds of uses to which they 
were put. 

c. The survey indicated that an average of 249 NIE' s were 
distributed regularly to the White House, the NSC, the Operations 
Coordinating Board and the major departments and agencies with 
national security responsibilities. Many of these were further 
distributed to major commands and missions outside Washington. 

d. Only a relatively few NIE's (selected by intelligence and 
screening officers) were seen by the President and department 
or agency heads, and in such cases these top-level individuals 
usually read only the conclusions, briefs, or selected portions. 

The exceptions were most likely to be NIE's dealing with crisis 
situations requiring urgent and high-level policy decisions. 

NIE's were, however, found to be extensively read by second and 
third echelon officials in major departments and agencies and by 
various staffs responsible for national security planning and 
execution. It appeared that some NIE's did not reach all of the 
departmental policy or planning levels or other key officials who 
might have found them useful. In some cases, this appeared to 
result from failure of subordinates to pass the NIE's to their chiefs, 
and in others the criteria for distribution appeared to be overly 
restrictive. 

e. NIE's were found to be most generally used for background 
purposes, although some were used in working on specific planning 
and policy problems. The majority of users indicated that the 
format and problem coverage of NIE's were adequate, but many 
expressed dissatisfaction with particular NIE's. There were 

^ oouplaints that the NIE' s were too long. to be read in full by top- 
level individuals; they were said by some to be too general for 
detailed use in policy planning and execution; and some were said 
to be not relevant or sufficiently timely for use in consideration of 
specific policy problems. Overall importance of such complaints 
was not considered sufficient to warrant action to alter the format 
or content of NIE's. Each Intelligence Advisory Committee * 
member was asked to reexamine the pattern of NIE distribution 
so as to improve the usefulness of NIE's to the policy, planning 
and executive branches of his agency. Each IAC agency was 

Succeeded by the U. S. Intelligence Board on 15 September 1958 

A- 2 | 
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requested to brief new key officials within its department on the 
nature of the NIE and the means at their disposal for requesting 
NIE's responsive to specific intelligence problems they might have. 


3. 


C onfere nc e, with the Assistant Secretary of State for Police 
Planning (1957 ) ~~ " 


The. DCI, Director of National Estimates and his BNE members 
met on 2S July 1957 with Robert W. Bowie, Assistant Secretary of State 
tor Policy Planning to discuss the form and content of the NIE program. 
Mr. Bowie's suggestions to enhance the usefulness of NIE's to the 
policy planning process were as follows: v 

a ' . There was undue emphasis on precise statements of 
probability, with too little discussion of underlying factors. 

b. In many cases, it would be useful to discuss more 
possibilities, even if they had only a 20 percent chance of 
eventuating. 

C. The estimate should show the degree to which predictions 
were based on evidence as opposed to judgment. 

d. Estimates should put more stress on the degree to which 

U u S ; i aCt j° n COuld affect the Predicted line of development, and 
what kinds of U. S. action could have impact. 

e. NIE's were not very readable, even on interesting 
subjects - -the conclusions were "dehydrated" and lacked flavor 
He also suggested that the IAC promulgate as "think pieces" a ' 
series of papers written by a single person or a small group (in 
the manner for Fo reign Affairs articles), for consideration by 
policy-makers. 


4. 


Survey of NIE Distribution (1959-1960) 


, a ' This surve y eff °rt had two aspects: (.1) the circulation 
ox a questionnaire enclosed in seven selected NIE's published 
urmg the period July 1959 to February I960 to obtain certain 
detailed information regarding the readership of NIE's, and 
(2) an inquiry to the distribution offices of the USIB agencies to 
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determine how NIE distribution is controlled. The latter is not 
relevant to the present study. The survey was undertaken to 
investigate the nature of and causes for an apparent large increase 
m NIE distribution from 250 in 1956; by I960 some 365 copies of. 
NIE's were regularly being sent to recipients according to a 
standard distribution list, and about 85 more were held in reserve 
for special distribution. The survey ascertained that the substantial 
increase since 1956 was attributed to the following factors: 

(1) Natural expansion of readership as the utility and 
significance of NIE's became more firrply established 
throughout the government. 

(2) The growing number of senior officials who required 
NIE's in carrying out their responsibilities. 

(3) An increasing number of users in the intelligence 
community itself. 

(4) The succession of world crises which generated 
increased interest in national intelligence on the part of 
commanders and planners. 

(5) A general increase in the number of people in the 

government concerned with the communist threat throughout 
the world, developments in modern technological warfare, 
and the capabilities and intentions of the Soviet Bloc. * / 

(6) The addition of new readers over seas - -political 
advisors, ambassadors, and military planners and commanders. 

(7) Agency reorganizations, including changes in locations 
of offices. 

(8) An increase in the size, responsibility, and complexity 
of agencies served by NIE's. 

(9) The establishment or expansion of reference and 
library facilities in the USIB agencies. 
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(10) An increase in the number of NIE's released to 
foreign governments. (From about 26 to 45) 

(11) An apparent increase in readers whose need to know 
might be marginal. 

b. An analysis of the returns from 636 respondents of the 
questionnaire addressed to NIE recipients indicated that about 
50 percent were engaged in intelligence, 19 percent had responsi- 
bilities in policy planning and coordination, and 8 percent were in 
operations. Only 7 percent listed themselves in the area of 
research. However, a substantial number of readers (34 percent) 
indicated that they read only the NIE conclusions. The questionnaire 
(at Tab 1) did not solicit ideas on how NIE's might be improved. 

■Q-.. < r r * es to Secr etaries of Defense and State re Soviet Military 
Estimates (1969) ~ “ 

a. In November 1969 the DCI asked the Secretary of State, 
the Secretary of Defense, and the Assistant to the President for 
National Security Affairs for their views or suggestions as to how 
National Estimates on Soviet military subjects might be made 
"most useful" to them. Questions included: (1) is the division 
by subject (Strategic Attack, Strategic Defense, and General 
Purpose Forces) the best way of presenting the estimates; (2) is 
the amount of detail presented excessive and should there be 
different types of estimates for different readers; and (3) do existing 
procedures provide intelligence judgments of most vital interest, 
together with adequate evidence or argument, and are dissents 
presented adequately? 

b. The Secretary of State offered no "fundamental" criticism, 
but his suggestions for "refinements" were as follows: 

There could be "summary estimates" for the top 
policy makers, more comprehensive than the 
conclusions" sections of the then current estimates, 
but more condensed than the then current estimates. 

This would permit the basic NIE to be more detailed 
and complete with a fuller presentation of the evidence. 
Annexes could provide background information on major 
issues, and there could be greater use of maps, charts 
and graphs. 


A - 5 
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There should be a greater effort to evaluate Soviet 
doctrine and strategy together with discussion of the 
fundamental differences of opinion within the 
intelligence community. These could be incorporated 
in the "basic estimate" and this might obviate the need 
to issue a separate NIE 11-4 as frequently as in the 
past. 

The "summary estimates" would be written after the 
basic estimates were completed and would give an 
over-view of major Soviet weapons systems and 
describe significant changes in Soviet forces. They 
would also include a discussion of the general nature 
of Soviet military expenditures. The "summary 
estimates" for 11-3 and 11-8 *** should be 
combined into a single paper so policy makers would 
have in one document an assessment of the main 
elements of information on Soviet strategic forces 
which have to be taken into consideration in calculating 
the US-Soviet strategic balance. This would be useful, 
for example, in discussing US options for the SALT 
negotiations. 

The estimates might contain a brief statistical 
summary of US forces, including forward projections 
drawn from the OSC FYDP, to give the reader a basis 
for comparing US and Soviet forces. 

c. The suggestions of the Secretary of Defense were as 
follows: 

Consideration should be given to relegating much of the 
detailed quantitative and qualitative analyses of 
Soviet weaponry to appropriate appendices. This 
would leave in the main body of the NIE only the 
more critical aspects of strategic weapons systems. 

The main body should also contain changes, dis- 
agreements of the intelligence community, and levels 
of confidence inherent in the principal judgments. 


* "Main Trends in Soviet Military Policy" 

* "Soviet Strategic Air and Missile Defenses" 
•- "Soviet Capabilities for Strategic Attack" 
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The estimates, especially the strategic attack and 
defense papers, should be revised and updated more 
often, perhaps quarterly. (The NIE on an annual 
basis was said to be of questionable usefulness a 
few months after its issuance. ) 

It would be useful to include five-year estimates in 
the NlEfe, perhaps less precise than the short-term 
estimates but more definitive than the ten-year trends 
of the then current estimates. 

Each NIE should have a section comparing major 
judgments of the previous NIE with the current 
judgment. Divergencies could be explained and 
tendencies to consistently over-estimate or under- 
estimate should be brought to the attention of the 
policy-maker so that he could determine the "hedge" 
factor he must introduce in decisions regarding 
defense programming and planning. 

d. The change which both the Secretary of State and the 
Secretary of Defense recommended- -that a condensed statement of 
the principal findings of Soviet military estimates be prepared for 
the top policy-makers-- was adopted and NIE' s on these subjects 
now have a lengthy summary and conclusions section at their 
beginning. Another suggestion of the Secretary of State was also 
adopted and resulted in a deeper probe of Soviet military strategy. 

NIE 11-4 (now "Issues and Options in Soviet Military Policy") has been 
retitled and considerably expanded in scope and depth. The Secretary 
of Defense's suggestion to include five-year estimates of Soviet 
force levels was also adopted, but in the form of several alternate 
projections for force levels, depending on assumptions as to the 
success of SALT talks, US alternate force levels, etc. 

Meeting with the White House Staff in 1970 

The Board of National Estimates and its staff members 
conducted a series of meetings in 1970 with the staff of the Assistant 
to the President for National Security Affairs concerning the form and 
content of military estimates. As a result of these meetings, a great 
deal more factual material was included in the estimates, together with 
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an expanded discussion of the factors leading to the conclusions of the 
estimate* On 8 March 1971 the President commended the DCI and "the 
entire intelligence community" for NIE 11-8-70 which the President said 
was a considerable improvement over the previous version. He stated 
that he found particularly useful: 

n --The frequent sharply -defined, clearly argued 
discussions of the various contested issues* 

"--The attempt to incorporate a wide range of 

sources, such as clandestine reports and Soviet 
SALT statements. 

"--The alternative force models based on explicit 
differences in underlying assumptions and the 
attempt to define which were the more likely 
models. 

"--The quantitative detail for each model which 
illustrates the differences between the models 
and gives an operational meaning to some of the 
general statements. n 
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C °N S UME R EVALUAT^N OF NATIONAL INTELLIGENCE ESTIMATES (NIE) 
AND SPECIAL NATIONAL INTELLIGENCE ESTIMATES (SNIE) 


PURPOSE 


t ■ ,P? 1S eva ] > uat '|on is an element of the National Security Council 

feedh^rtn 6 - 0 ?" 11 ! 1 !^ 66 (NSCI 9 P r °9^m intended to provide^expl icit 
Ifn+c k t0 n i e J ll9en ^ e P roducers f rom consumer users under arranqe 
ments sponsored by each NSCIC Working Group member in his deoartment 
or agency. This evaluation should not be prepared by iJLlligeJce 

lloZt H a non-lnte ^i9ence use/eva^o^l 


INSTRUCTIONS 


^ req “ es J ed t0 complete this form within 30 days 
following publication of the NIE or SNIE. y 

th _ Security classification of the completed form will be based or 

c SS1 ? Cat T the estimate being commented upon and 
classification of the comments included in the evaluation. 

The completed evaluation is to be forwarded to; 


D/DCI/IC 
Attn: PRG/IC 
Room 6 E 18 
CIA Headquarters 
Washington, D.C. 20505 
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EVALUATION REPORT 


Identification of Estimate Evaluated 
(NIE) (SNIE) No. 


Ti tl e 


Source of Evaluation 
Organization address: 


Contact: 


Estimate Utility and Timeliness 


Telephone 


1. Primary use to which estimate is being or will be put: 


a. Policy planning 

b. Operations planning 

c. Background information 


d. Military force planning_ 

e. Military R&D planning ~ 

f. Other (specify) 


2. Utility of this estimate for ongoing or anticipated policy/operations 
problems : 


a. Absolute necessity 

b. Very useful 

c. Useful 


d. Nice to have 

e. Little or no use 


3. If some other source currently satisfies the need for this 

estimative information in an equal or better fashion, identify 
such source: 


Timeliness of the estimate: 
a. Very timely b. 


Timely 


Not timely 


If c. checked, how could timeliness have been improved? 
Why is estimate not considered timely? 
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Scope and Format 

1. The scope arid format of the estimate are: 

a. Excellent b. Satisfactory c. Unsatisfactory 

2. How could the scope and/or format of the estimate be improved? 
To support what uses? 



E. Factual Data 

1 • For purposes of your organization, the degree to which 
factual data is presented is: 

a. Excessive b. Sufficient c. Not enough 

2. For what purposes would more or less detail improve the 

utility of the estimate? 

* 


F. Expression of Uncertainties 


1 . 


2 . 


3 . 


The uncertainties relating to the data 
described are brought out: 


or the situations 


a. Excellently b. Satisfactorily c. Inadequately 


For purposes of your organization, the estimate treats the 
full range of uncertainties: 


a. Very well b. Adequately c. Inadequately 

How could the treatment of uncertainty be improved? 
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G. Expression of Alternatives 


proiections^nd the ran 9 e of' alternative 

projections and the description of each alternative are: 


a. Quite comprehensive b. Adequate c 

How could the presentation of alternatives be improved? 


Inadequate 


H. Quality of the Estimative Logic 

’• 3JI fa^^i t LH h « C 5- th f- ana1 f 1s 1<J 9 ical, y ties together 
tne taCc.ua. and estimative elements of the paper is: 


Excellent b. Satisfactory 


How mi 9 ht ^is aspect of the estimate be improved? 


Inadequate 


I* Overall Reaction to the Estimate 

your E reactions r to S the f estlLto Ct1 2 n ( . 1S to encoura 9 e y°“ to summarize 

s=*r« s.trv“JSsSS5“S3r 

’• estimate: the f ° ,,0win3 words and Phases characterize this 


a. Exceptionally valuable 

b. Stimulating and persuasive 

c. Imaginative new viewpoint 


e. 

f. 


Rehash of conventional 
wisdom 

Shallow and unconvincina 
Dull 
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MEMORANDUM FOR: Members of the National Security Council 
Intelligence Cormittee 


SUBJECT: 


Intelligence Consumer Participation in the 
NIE/ SNIE Program \ 


25X1 


1. This memorandum implements NSCIC approval of proposals 
submitted by the NSCIC Working Group aimed at increasing consumer 
involvement in the National Intelligence Estimate (NIE) and 
Special National Intelligence Estimate (SNIE) process. These 
proposals respond to comments in the President's memorandum of 

5 November 1971 and the NSCID No. 1 of February 1972 which relate 
to improvement of intelligence production. 

2. To enable high level consumer comment on production 
schedules for NIEs, it is requested that the Director of Central 
Intelligence arrange to have copies of the draft quarterly NIE 
schedules distributed to members of the NSCIC Working Group 

at the same time the draft schedules go to USIB representatives. 
Those Working Group representatives who represent NSCIC principals 
are to arrange for provision of the comments and/or concurrence of 
their principals on each quarterly schedule to the Chairman, 

NSCIC Working Group- and to the Director of National Estimates 
at CIA. 

3. It is recommended to the Director of Central Intelligence 
that he request the Director of National Estimates to invite 
comments by NSC staff members and non-intelligence representatives 
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government agencies as appropriate on draft terms of reference 
for NIEs and SNIEs when he considers that inputs from outside 
the intelligence community would provide useful indication of 
the intelligence needs of customers for whom the estimate is 
being prepared. 

4. It is requested that the Chairman, NSCIC Working Group, 

\ 

arrange for distribution of a copy of each published NIE and SNIE 
to those Working Group members who represent NSCIC principals, 
along with a copy of the "Consumer Evaluation" questionnaire 
approved by the NSCIC. Those Working Group members who represent 
NSCIC principals are charged with furnishing the Chairman of 
the Working Group and the Director of National Estimates with 
fill ed-i n evaluation forms and such other comments as are appropriate 
within 30 days of the publication date of the NIE or SNIE. 


Henry Kissinger 
Chairman, NSCIC 


a LI* 
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